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Abstract:  8*wl  algorithms  already  «dst  for  solving  tha  uncapaciiatad 

facffitr  location  problanu  Tha  Boot  efficient  aro  baaod  upon  tho  solution  of 
££•  strong  Hnoar  progrsaa ing  relaxation.  Tho  dual  of  this  relaxation  has  a 
ocandonood  form  which  nonoiota  of  ainiatring  a  certain  piecewise  linear  convex 
function.  Thin  paper  presents  a  now  Bothod  for  solving  the  uncapacitated 
fheffity  location  problem  baaed  upon  tho  exact  solution  of  the  condensed  dual 
via  orthogonal  projections.  The  amount  of  work  per  iteration  is  of  the  asae 
order  an  that  of  a  staples  iteration  for  a  linear  program  in  a  variables  and 
conatratets,  where  a  is  the  nuaber  of  clients.  For  comparison,  the  underlying 
linear  prograaaing  dual  haa  an  ♦  a  ♦  n  variables  end  an  ♦  n  constraints, 
where  n  is  the  nuaber  at  potential  locations  for  the  faculties.  The  method  is 
ftadble  as  it  can  handle  aide  constraints.  In  particular,  whan  there  is  e 
duality  gap,  the  linear  prograaaing  formulation  can  be  strengthened  by 
adding  cuts.  Numerical  results  for  aoae  classical  test  problems  are  included. 
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toeflity  location  problem  can  be  stated  a a  follows. 


Sfeppoae  tea  tea#  a  eUanta  indexed  by  I  s  (1,  2,  ...,  a)  and  n  potential 
attae  tor  opening  todHtiae  indexed  by  J  s  (1,  2,  ...»  n).  We  are  given  the 
profit  C|j  that  can  be  accrued  froa  aupplying  all  at  client  i'a  demand  from  a 
facility  In  location  J,  and  the  fixed  coat  f  j  >  0  for  aetting  up  a  facility  in 
location  j.  The  problem  eonaieta  of  aelecting  an  optiaal  aet  at  facility 


locations  and  assigning  the  clients  to  theee  facilities. 

Let  y,j 

represent  the 

fraction  at  client  i'a  demand  supplied  from  facility  j. 

Define 

1  if  facility  j  ia  open. 

XJ  l 

0  otherwise. 

Than  oar  nodal  problem  ia 

Mw  I  Z  cijy,j  - 

(1.1) 

i«I  j»J 

j.j 

I  TlJ  »  1 

for  ell  i  t  I 

(1.2) 

Xj  ~  Tij  >  0 

for  all  i  «  I,  j  « 

J 

(1.3) 

for  all  i  •  I,  j  « 

J 

(1.4) 

Xj  «  {0,1}  .  for  ell  j  •  J. 

(1.5) 

The  constraint  (1.2)  expreeeee  the  toct  that  an  of  client  i’s  demand  is 
supplied,  end  (1.3)  expreeeee  the  fact  that  we  can  only  supply  tha  clients 
fkom  open  facilities. 


This  model  has  been  extensively  studied.  See  [7)  for  e  recent  aurvey  of 
the  literature.  By  relaxing  tha  0,1  restriction  on  Xj,  we  obtain  the  so-called 
strong  linmmr  programming  relaxation  of  tha  uncapacitated  facility  location 
problem.  More  precisely,  we  replace  (1.5)  in  the  above  formulation  by 

0  i  Xj  i  1  for  all  j  «  J.  (1.6) 
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an). 


(■bout  OJX)  is 


It  turns  out  that  its 


arising  fron 


Swain  [191,  Oarflnkel*  Neebe  and 
[8],  BrlankottarClO],  Huh*?  and 


o f  vary  snail 


[1].  Much 


by  a  probabilistic 


tha  uniform  ooat 


We  also 


but  this  nodal  is  not 


of  tha  aiaa  of  tha  strong  linsar  progransring 


4  n  varieblea)  and  its  apacial  structural  it  ia  not 


nathod  diractly.  Tha  standard  Unaar  progranming 


dual  of  problan  (1.1M1.4),(1.6)  can  ba  writtan  as 


I  n«  +  I  tj 
i«I  .  J«J 

*1  +  "ij  1  C|j 
-  £  W|j  4  tj  2  -  fj 

isl 

"«j.  tj  l  0 


for  all  i  i  I,  j  i  J 

for  all  j  «  J 

for  all  i  •  I,  j  •  J. 


(1.7) 

(1.8) 

(1.9) 

(1.10) 


This  Is  a  problan  in  am  4  n  4  n  variables,  but  it  is  poasibla  to  rswrita  it  in  a 
condsnsad  fora  in  tha  light  at  tha  following  observations. 

Wa  not a  from  tha  torn  of  (1.7)  that,  tor  any  given  u,’s,  we  would  like-  to 
naira  tha  t/s  as  sontll  a a  possible.  Thus,  using  (1.9)  and  (1.10),  we  require 


‘‘  *  [£"•'  *  ■ 


(1.11) 


where  a*  s 


(0,a).  Consequently ,  wa  would  like  to  make  w, .  as  snail  aa 


possible.  Constraints  (1.8)  and  (1.10)  inply  that  wa  should  have 

W|j  s  (Cij-Uf)^. 


(1.12) 


v  .  ■.  >.* 


(1.7M1.10) 


by  Um 


II  li  ia*  yaaftb  to  itpbM  Um  dual  pralha 

faflowing  mmtmmd  dual 

Mm  ?(«)  -  X  «i  ♦  X  St(«)  (1.13) 

a  ial  j«J 

afcara  •J<a)  •  X  >♦  -  *i-  (1.14) 

ial 

U»  raark  that 

(a)  tUa  tranafarwalian  ia  wall  known.  8m,  far  aaanpla,  Spklbvf  [SI]  and 
•rlaahottar  [10]. 

(b)  F(u)  ia  a  piacawiaa  Uaaar  eonrat  objacttm  function* 

(e)  Problaai  (1.13)  la  an  unoonaimlnad  optiniaatinn  probl—  in  a  raxdablaa. 

(d)  Tbara  ia  an  optiaua  aohiUoa  at  (1.13)  auch  that  8j(u)  £  0  far  all  j  •  J. 
(To  aaa  thia,  aota  that  tba  ooaatraiat  tj  £  1  of  (1.8)  ia  auparfluoua  ia  tha 
atroag  Uaaar  progranaring  ralaaailoa  aiaea  wa  hm  aaaunad  fj  >  0.  Thia 
ahowa  that,  ia  tba  dual,  wa  can  always  aat  tj  a  0.) 

Ia  thia  papar  wa  propoaa  a  nathod  that  niniadaaa  F(u)  diraotly  a a  .a 
piacawfaa  Uaaar  function.  Saction  2  outUaaa  tha  nathod  and  providaa  tha 
theory.  Saction  3  containa  tha  proof  of  tha  nain  thaoraau  Saction  4 
daacribaa  tha  algorithn.  and  Saction  5  raporta  our  oonputational  axparianca. 
Saction  4  daacribaa  eoaaaetiona  batwaan  our  nathod  and  Brlaakottar'a. 
Finally,  in  Saction  7.  wa  diaeuaa  axtanaiona  of  tha  nathod. 

Ia  tha  ranaiadar  of  thia  aaction  wa  provida  additional  background  on  tha 
uacapacitatad  facility  location  problan.  Thia  problan  ia  NP-hard.  Tharafora  it 
ia  not  aurpriaing  that  noat  of  tha  axact  ablution  nathoda  propoaa d  in  tha 
tttaratura  raaort  to  branch  and  bound.  Tha  ouccaaa  of  auch  algoritlma 
dapaada  on  tha  avaUabiUty  of  a  tight  raia ration.  Tha  ao-callad  waalr  linaar 
progranniag  ralaaatkm  ia  daflaad  by  replacing  (1.3)  by 
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,  III  ■ 

IMmUi  (Mb  nhalhNi  Is  wy  way  io  solve,  its  uss  within  ths  eontnt  of 
brameh  sad  bound  lands  io  lsrgo  enumeration  trees,  mn  for  rdstinly  sasll 
yvohlHS  (soo  ItraysM  and  bty  [9])*  Ths  strong  Hnasr  prograa taring 

fdanUoa  (LlHU)i(14)  on  ths  othor  hand  produoso  asm  singly  tight  bounds* 
so  wo  haws  notsd  abndy.  Solving  it  is  an  intar  soling  challenge  aa  its 
strusturs  can  ba  exploited  in  many  diffsrant  ways.  Oarflnkel,  Nsabs  and  Rao 
Cll]  solved  ths  atrong  tin  Bar  programming  relaxation  by  Dantsig-Wolfe 
Schraga  120}  devised  a  variable  upper  bound  simplex  algorithm 
to  hanrtlt  ths  constraints  (1.3)  while  Morris  [16]  traatad  than  as  cutting 
pianos  to  ba  inoorporatad  so  noadad;  finally  Ouignard  and  Sptslbsrg  [14] 
propooad  to  pivot  only  on  unfanodular  baas  a.  AH  thssa  ant  hods  ara  variants 
of  ths  primal  simplex  algorithau  For  ths  purpose  of  branch  and  bound, 
however,  thhre  ara  advantagao  to  aohring  the  dual  of  ths  relaxation  instead  of 
the  primal,  aa  any  dual  feasible  notation  yields  a  valid  bound.  We  have  seen 
alrBOify  that  the  dual  has  a  oondanaad  form  (1.13).  Srlankotter  [10]  sriniarfsed* 
this  piecewise  tin  ear  convex  function  using  a  daaoent  heuristic.  Narula,  Ogbu 
and  Soaaaalaoon  [IS]  and  Oorauajols,  Fisher  and  Henhouaer  [6]  used 
oubgradient  optimisation.  Both  approaches  quickly  yield  good  dual  solutions, 
are  easy  to  program  and  well  suited  for  branch  and  bound  algorithms. 

Beoently  some  great  auccaooas  have  been  achieved  in  the  solution  of 
combinatorial  optimisation  problems  by  combining  a  cutting  plane  approach 
with  branch  and  bound,  aoa  Qrotachel  and  Pad  berg  [12]  for  example.  In  order 
to  generate  cutting  planes  for  the  uncapacitated  facility  Ipcation  problem,  it  is 
desirable  to  solve  the  strong  linear  programming  relaxation  to  optimality. 
Since  the  primal  has  many  more  variables  than  the  condensed  dual  —  mn  +  n 


Tamil  a  — ,  it  nw  appropriate  to  aolve  tha  latter.  Subgradient 
optiadaation  can  ba  vary  alow  to  achiava  optiaality  and  Brlankottar'a  dual 
daacant  algorithm  ia  a  heuristic,  so  naithar  approach  ia  wall  suited  to  solving 


tha  eoadanaad  dual  optimally.  Tha  praaant  pap ar  propoaaa  an  algorithm  to 
aolva  thia  condanaad  dual  to  optiaality. 

Tha  baat  cutting  planaa  a ra  thoaa  that  generate  facata  at  tha  convex  hull 
at  tha  solutions  to  (1.2)  -  (1.5).  Thia  polytopa  ia  known  a a  tha  uncapacitatad 
facility  location  polytopa,  and  its  facata  hava  baan  partially  daacribad  by 
Guignard  [13],  Cho,  Padbarg  and  Rao  [3]  and  Cornuejola  and  Thicy  [8].  Por 
example,  tha  inaquality 

Yr$  *  Ymi  +  7s*  +  7th  *  7tk  +  7rk  “  **  “  *h  -  Xk  <  1  (1.15) 

daflnaa  a  facat  at  tha  uncapacitatad  facility  location  polytopa  for  any  t,  h,  k  i 
J  and  r,  a,  t  «  I  such  that  i  t  h  t  k  and  r  t  a  t  t.  It  cute  off  fractional 
bade  solutions  of  (1.1)«(1.4),(1.6)  •  whars  all  tha  variables  in  (1.15)  taka  tha 
valua  1/2.  Adding  the  constraint  (1*15)  to  (1.1)-(1.4),(1.6)  and  taking  tha  dual, 
wa  gat 

Min  I  ut  +  I  t.  +  v 
i*I  j«J 

u,  +  "14  >  cij  for  all  (i,j)  /  (r,«),(a,4),(sth),(tfh),(t,k-),(r,k) 
u,  +  w,j  +  w  >  c,j  for  (i, j)  =  (r, <),(»«  O , (s,h) , (t,h) , (t,k)  or  (r,k) 

-  £*ij  +  tj  >  -  fj  for  all  j  /  t,  h,  k 

-  £w,j  +  tj  -  v  >  -  fj  for  j  =  I,  h  or  k 

t4,  v  >  0. 

Therefore  tha  new  condanaad  dual  is 

Min  F(u,v)  *  £  u<  +  I  St(u,v)  +  v  (1.16) 

v£0,u  i«I  j«J 

"bare  S,(u,v)  *  £  (e, .-*,)+  -  f.  (1.17) 

i*I 
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for  (i.j)  f  (r,  t) ,  (s,  I) ,  (s,h) ,  (t ,h) ,  (t,k) ,  (r,k) 
for  (if j)  *  (r,l),(a,l).(o.h),(t,h)t(ttk)  or  (r,k) 
for  j  f<  «,  lit  k 
for  j  >  I,  h  or  k. 


This  otMpk  ikon  that  Um  general  form  of  tho  condon— d  dual  is  preaerved 
when  a  outline  plans  such  aa  (1.15)  ia  added.  Mors  generally,  if  p  constraints 
aro  addod  to  tbs  priori  formulation,  tho  condonssd  dual  has  p  now  variables. 


Bxcept  for  tho  nonnagativity  of  thaoo  variables,  tho  now  condensed  dual  is 
still  the  unconstrained  minimisation  at  a  convex  piecewise  linear  function.  For 
the  sane  reason,  tho  potential  extensions  of  tho  condensed  dual  include  the 
capacitated  facility  location  problem.  We  wiD  not  treat  this  latter  extension  in 
tMe  paper i  but  both  extensions  further  justify  our  interest  in  the  condensed 
dual  F(u). 


2.  Motivation  and 

Aa  wo  hare  already  seen,  we  are  initially  concerned  with  the  following 

optimisation  problem 

»On  F(u)  «  l  u,  +  I  fft(u) 
uHT  i«l  j=l 


Si(u)  »  I  (ct.-u,)*  -  f«. 

i*l 

Clearly  F(u)  ia  a  piecewise  linear  convex  function. 


(2.1) 

(2.2) 


It  is  nondifferentiable  at  all  points  u'  such  that  eithar 
i)  Sj(u)  *  o  for  sens  j  »  J  *  {1,  ...,  n) 
or  ii)  C|j  =  u,  for  some  i  •  I  =  {1,  ...»  a}  with  Sj(u)  >  0. 


(2.3) 

(2.4) 


Wa  call  thaaa  activities  (breakpoints)  of  type  i  and  type  ii,  respectively. 


'  '  .■  V. 

W»  llwS  dafiM  the  following  index  sets  at  a  point  u. 


J+(u)  Sj(u)  >  0)  (2.5) 

J#(u)  s  {j  »  J  :  S  j(u)  s  0)  (2.6) 

J-(u)  s  fj  •  J  :  Sj(u)  <  0)  (2.7) 

Ij(u)  *  {i  •  I  :  c,j  -  u1  >0}  (2.8) 

I}(u)  *  {i  *  I  :  c*j  *  U|}  (2.9) 

rj(n)  *  {i  •  I  :  c,j  -  u,  <  0}  (2.10) 

I°(u)  »  u  17 (u)  (2.11) 

j«J*(u)uJr+(u) 

Jt(«)  *  (j  «  J+Cii)  :  i  •  IJ(n)}  (2.12) 

Jf(u)  *  U  «  J°(«)  :  i  «  I](u)}.  (2.13) 


Whenever  the  underlying  u  ia  evident,  we  will  write  J*  for  J+fu),  ate. 
Uaing  the  above  definitions 


F(u)  e  I  u,  +  £  Sj(u). 
i.I  j«J+ 

As  we 

shall  see,  it  ia  useful  to  define  a  "bai 

■e  gradient"  for  F(u).  Thua  we 

define 

* 

g(u)  *  e  +  I  v  Sj(u) 
jaX*1 

(2.14) 

where 

a  *  (1,...,1)T  a  R",  and 

* 

V 

Sj(u)  *  (mi .... ,ai)T  •  «■, 

(2.15) 

f-1  if  i  *  Ij  u  I] 
sf  *  1 

(2.16) 

l  0  otherwise. 

Notice  that  g(u)  expresaea  exactly  the  first  order  change  in  F(u)  along  the 
direction  d  when,  in  this  direction,  the  u<’s  such  that  i  «  IJ,  j  t  J+  happen 
to  decrease  and,  further,  Sj(u)  remains  zero  for  all  j  *  J°.  This  statement. 
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Let  «| 


iraml  ekiniMf  ia  the  buia 


iltt  ith  unit  vector  in  1^.  V«  first  state  tha  following 


Sal*  Tha  point  u* 


problem  (2.1)  if  and  only  if  thara  exist 


Xj  and  sf  t  oallad  tha  Lagranga  dual  variables*  such  that 

g<«*)  *  X  xj  *  Sjitt*)  -  X  M fat 

i# !•(«*) 


-  1  i  Xf  i  0 


for  j  •  J*(u*) 


0  £  sf  i  -  X  Xf+  for  i  «  I«(u*). 


(2.17) 


(2.18) 

(2.19) 


Tha  thaorsai  ia  constructive  in  tha  sanaa  that  whenever  tha  conditions 
(2.17M2.19)  a to  not  aatisfiad,  it  ia  relatively  atraightforward  to  obtain  a 
daacant  diraction  for  F. 

Mora  apacificaQy,  tha  motivation  is  as  follows.  Wa  first  try  to  obtain  a 
daacant  diraction  by  projscting  -g(u)  orthogonally  into  a  spaca  such  that 
J*(u)  u  I*(u)  doaa  not  change  (tha  activities  remain  active).  A  daacant 
direction  is  obtained  whan  such  a  projection  ia  nonsero.  Whan  tha  projection 
ia  aero*  it  fbllowa  that  g(u)  can  be  expressed  entirely  in  terras  of  v  Sj  (u)  for 
j  «  J*(u)  and  a i  for  i  c  I°(u).  Thus,  wa  are  able  to  consider  tha  affect  of 
dropping  a  single  activity.  This  either  determines  a  descent  diraction '  or 
establishes  tha  required  optimality  conditions. 

Wa  will  try  to  aake  this  more  concrete  by  considering  a  simple  example. 
Consider  a  a  n  a  3, 


•  i  «  i  * 
»  *1  «■* 


i? yv/.w  i*1  >,<TtvTivv vw y»i 


(c«j)  * 

3  1  4 

14  4  SJ 

«■* 

(fj)  •  (2  1  3). 

#a«  /n«  /<•%  /It  /lit 

Optimal  «*’s  are  1 

15, 

4  d  J  1  £ 

,  1  ,  1  ,  2  ,  2  ,  1  or  any  convex  combination 

14  14  4 

of  1 

tlMMI 

rii 

Wa  taka  a*  *  ] 2 ]  as 

our  initial  point.  F(u°)  * 

11  and  J*(u°)  =  (1,  2,  3}. 

Wa 

have  no  activity  at  typa  i  but  one  activity  of 

type  ii  given  by  u?  =  c,  3 

Th*  b ana  gradient  at  u*  is  g(u*)  a  (-2,-l,-2)T.  We  maintain  the  activity  of 
typa  ii  by  chooeing  our  aoarch  direction  in  a  rpace  orthogonal  to  (-1,0,0)T. 
Thus,  w®  taka  our  aoarch  diraetion  to  ba  d°  =  -Pg(u°)  whara  P  is  tha 
orthogonal  projactor  onto  tha  apnea  orthogonal  to  tha  apaca  ■  panned  by  tha 
gradianta  of  tha  activitiee.  Thua  in  our  example,  d°  s  (0,1,2) T. 

Wa  now  daocand  aa  much  aa  poaaibla  in  this  direction  while  minimizing 
tha  mntirw  function  P(u).  Thia  gives  a  .  step  aixa  of  1/3  and  hence  u1  = 
(1,  2+1/3,  3+2/3) T*  Ptor  thia  point,  P(u»)  s  9+1/3,  J+(u»)  s  (2),  J°(u»)  =  (1,  3), 
IT  and  Xf  a re  empty,  and  If  =  (1).  Thia  time  g(u* )  =  (0,1, 0)T  and  wa  project 
orthogonal  to  t  S^uM  s  (-1,-1,-1)T,  *  S3(u*)  s  (-1,-1, -1)T  and  et ,  obtaining 

d1  s  (0,-1 ,1)T,  whara  without  loaa  of  generality  d 1  haa  bean  suitably  scaled. 

The  optiaml  step  aixa  for  tha  lino  search  ia  again  1/3  and  thus  u3  = 
( 1,2,4) T.  Thia  gives  P(ua)  a  9,  J+(ua)  a  (2),  J®(ua)  =  (1,3),  I?  =  (3),  I?  =  (3) 
and  I|  a  (1).  Now  g(ua)  =  (0,1,0) T  but  tha  projection  is  zero.  The  point  u3  ia 
a  degenerate  stationary  point  but  in  thia  particular  case  it  ia  easy  to  choose  a 
suitable  basis.  Wa  choose  *  S3(u3),  ®,  and  e3.  Now 
g(ua)  s  X,  v  S3(ua)  -  MiSj  -  M,e, 

with  X,  s  -  1  and  i»i  a  M*  *  1.  Clearly,  condition  (2.18)  of  Theorem  2.1  holds. 
To  check  condition  (2.19)  note  that  J?(u3)  a  (3)  and  Jt(u3)  is  empty.  So,  for 
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Mf 


|t  this  condition  raducM  to  0  <  px  <  -  X*  which  ia  satisfied.  For  i  =  3  we 
ham  <I$(u*)  s  (I)  and  Jt(u*)  s  {2}*  In  thia  caaa  the  condition  (2.19)  reducea 
i.;.'  to  0  X IH  Sl  Again  the  condition  ia  aatiafiad. 

Therefore,  according  to  Theorem  2.1,  the  point  u*  ia  optimum  for  our 


Given  an  optimum  dual  aolution  u*,  we  can  derive  an  optimum  primal 
notation  to  the  strong  linear  programming  relaxation  by  using  the 
complaaamtary  alack neaa  conditiona.  Namely 

j  a  J+(u*)  implies  xj  s  1  (2.20) 

j  a  J-(u»)  implies  xj  s  0  (2.21) 

i  a  rj(u*)  impUea  y*,  j  s  x*,  (2.22) 

i  a  rj(u*)  impliea  y*,  j  =  0.  (2.23) 

The  values  of  x|  for  j  a  J°(u*)  are  the  optimum  Lagrange  dual  values  xj, 
up  to  the  sign.  Namely 

j  a  J*(u*)  impliea  xj  s  -Xf.  (2.24) 

The  mason  for  (2.24)  ia  that  (2.22),  (2^3),  (1.2),  (1.3)  and  (1.4)  imply  the 
existence  of  0  £  «ij  £  l  such  that 

I  xf  +  X  «ijxf  +  X  «1j  *  1 

4aJ*:ialj  jajf  j«J| 

This  is  equivalent  to  (2.17)-(2.19). 

In  our  example,  these  conditions  yield 

xf  *  0  (by  2.24) 

xf  *  1  (by  2.20) 

xf  «  1  (by  2.24) 

yfa  *  yfs  *  yf*  *  1  (by  2.22). 


for  i  i  u  It. 
j'J+ 
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Xft  ardor  to  prort  Thooron  2.1,  wa  will  require  ftrs  Is— as. 
Alforitkaioally,  aaoh  Imhh  will  cormpoad  to  a  —no  of  datanaining  a 
daooaat  dtraetion,  whan  on  exists. 

Lot  P  donoU  tho  orthogonal  projoetor  onto  Um  opoco  orthogonal  to  Uw 
opooo  oponnod  by  ?  3j(u)  for  j  «  J*(u)  and  a<  for  i  •  I*(u). 


Loomoo  3.1.  Xf  Pg(u)  io  nonsaro,  than  d  *  -  Pg(u)  ia  a  daaoant  direction  for 
P(u>. 

Proof!;  It  followa  froai  tha  dafhdtion  at  P  and  tha  fact  that,  for  a 
sufficiently  oaall  atop  oioa  a,  tha  indao  aato  J*,  J“,  1}  and  Ij  do  not  change, 


P(u+ad)  a  P(u)  ♦  adTg(u).  (3.1) 

But 

dTg(u)  a  -  g(u)TPTf<u>  a  -  |  Pg(u)  |*  <  0,  (3.2) 

using  tha  that  that  P  io  on  orthogonal  projoetor  (WT^»aP)  and  tha 
aaouoptinn  that  Pg(u)  t  0. 

Oonoa  quently  P(u+ad)  <  P(u)  for  all  ouffioiantly  aaafl  pooHlen  a.  o 

Now  ouppooa  that  Pg(u)  a  0,  or  equivalently 

g(u)  «  I  y  8j(o)  -  I  Mia,.  (3.3) 

It  will  ba  convenient  to  mamma  that  tho  Multipliers  Xj  for  j  «  J*  and  m,  for 
i  «  I*  ora  uniqualy  daflnad.  Thio  can  ba  raalioad  by  Methods  such  as 
parturbation  tachniquao.  Indeed,  thio  io  aaaetly  analogoua  to  tho  situation  in 
Unaar  programming.  So,  without  loan  of  generality,  wa  aaha  tho  following 
aosuaptinn  for  tha  naat  four  haaao. 
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The  vectors  *  Sj(u)  for  j  *  J©(u)  and  e(  for  i  *  I©(u)  are 


From  a  ooaputRdnul  point  of  view,  a  parturbation  technique  ia 
undesirable  Our  algoritharic  approach  to  degeneracy  ia  prasantad  in 


Laaaaa  U.  tf  Xh  >  0  for  momm  k  «  J°,  than  d  =  -  Pkg(u)  ia  a  daacant 
direction  for  P(u),  whara  Pk  danotaa  tha  orthogonal  projaetor  onto  tha  apaca 
orthogonal  to  tha  apaca  apannad  by  v  Sj(u)  for  j  »  J°\{k)  and  a*  for  i  »  1°. 


Praafi  Wa  firat  nota  that*  uaing  (3.3)  and  tha  definition  of  Pk, 

P*g(u)  *  X„  P««  r  Sk(u).  (3.4) 

Thua  dT  r  8k(u)  s  -  Xk  e  3k(u)T  Pk  a  Sk(u) 
a  .  Xk  |  pk  a  Sk(u)  |*  <  0, 

whara  tha  inequality  follows  tram  tha  facta  that  Xk  >  0  (hypothaaia)  and 
Pk  f  8k(u)  t  0  (Aaounption  U). 

Thua  8k(u)  daaoanda  in  tha  diraction  dt  La.  it  changaa  from  an  activity  of 
typa  i  to  bring  atrietly  nagativa.  All  tha  other  activities  rewain  active.  So, 
an  far  tha  proof  of  Laaaaa  3.1,  wa  gat  F(u+«d)  s  F(u)  +  «dTg(u)  <  F(u),  for  all 

auffhdauUy  auall  positive  «.  a 


M.  If  Xk  <  -  1  for  eoaai  k  •  J°,  than  d  s  -  Pkg(u)  ia  a  daacant 
whara  Pk  ia  defined  as  in  Laouaa  3.3. 


Proof:  As  in  tha  proof  of  Leanaa  3.3, 

d*  ?  8k(u)  *  -  Xk  |Pk  Z  Sk(u)|a. 


(3.5) 
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Saaoa  dT  *  Sk(u)  >  0  and,  for  mil  positive  a, 

P(u+ad)  s  P(u)  ♦  «dTg(u+od) 

s  P(u)  ♦  «dT(g(u)  ♦  *  Sk(u)). 

Silica  dT|(u)  s  Xk  dT  *  Sk(u), 

P(u+«d)  s  P(u)  ♦  «<Xk+l)  dT  ?  Sk(u).  (3.6) 

Consequently,  we  will  have  daacant  if  Xk  <  -  1.  □ 

Lamm  3JS.  If  <  0  for  mm  It  t  1°,  than  d  s  -  Qkg(u)  is  a  daacant 
direction  for  P(u),  where  Qk  danoiaa  tha  orthogonal  projactor  onto  tha  spaca 
orthogonal  to  tha  apaca  apannad  by  ▼  Sj(u)  for  j  *  J°  and  at  for  i  t  I°\{k). 

Proof:  Using  (3.3)  and  tha  daflnition  at  Qk, 

Qkg(u)  s  #»k  Qkak  (3.7) 

Thus  dT(-ak)  a  -Mfc  |  Qkak  |a. 

Sinca  m*  <  0  by  hypothaais  and  Qka|,  t  0  by  Assumption  3.2,  wa  have  that  uk 

is  decreasing  in  tha  diraction  d. 

Now  it  follows  from  tha  definition  of  »  Sj(u)  that 

f(u+sd)  *  a  +  I  v  Sjfu+ad) 
j«J*(u+ed) 

*  a  +  I  v  Sj(u)  *  g(u), 

4«J*(u) 

for  sufficiently  sasill  positive  «.  Thus 

P(utad)  *  F(u)  +  «dTg(u)  for  sufficiently  small  «  and  dTg(u)  a 
-  |  Qkg(u)  |*  <  0.  0 

lam  3.6.  If  Mk  >  -  £  X,  +  |  Jf  |  for  soao  k  *  1°,  than  da-  Rkg(u)  is 

j.J{ 

a  daacant  diraction  for  F(u),  where  Rk  denotes  tha  orthogonal  projactor  onto 


to 


apannad  by  *  Sj(u)  +  ek  for  j  •  J£*  *  Sj(u) 
a,  for  i  «  X*Mk). 


(3*1)  and  the  definition  of  Rk 

*K«)  *  -  (*f*  £  Xj)  B*ek.  (3.8) 

*»<-«*)  •  -  (**♦  C  Xj)  |  BkekI*. 
fiaaa  M%  ♦  £  X,  >  0  by  hypothaaia  and  B*ak  f  0  by  Aaaoaption  3.2,  wa 

j«J| 

obtain  tha  proparty  that  nk  ia  incraaaing  aloof  d. 


•  for  «  aafficiaatly  aaall  and  poeitive, 
a  8j(u)  +  ak  if  k  *  IJ(u) 
Sj<«a) 


♦  8j(«+*d)  * 


C 


(3.9) 


Tharafora,  f(u+«d)  *  a  +  £  v  S«(u)  +  £  ak,  i.a. 

j«J+(u)  j«J*(u) 

g(w*«d)  *  g(u)  +  |Jt(u)|  ak. 

thing  (3.8)  and  (3.10),  an  obtain 

B*g(tX«d)  ■  -  0»k  +  £  Xj  -  |jfc(«)|)  Bkak.. 

j«J?(u) 


(3.10) 


*k  a  M*  *  £  Xj. 

j»J£ 


lat  Tk  *  Mfc  +  £  X,  -  |jtl 

dTg(n+ad)  «  vk(ak)T  (H*)T  g(n+«d) 

*  -rkTk(«k)T  *h«k  *  ~  vkrk  |  Bkek  |*. 

By  hypothaaia  rk  >  0  and  vk  >  0.  So  dTg(u+«d)  <  0  and  tharafora 
7(u+«d)  a  7(u)  ♦  «d*g(u+«d)  <  P(u) 
for  sufficiently  avail  poaitiva  «.  a 


Proof  at  Thaorov  2*1. 

It  foUowa  diractly  from  Larnnaa  3.1,  3.3,  3.4,  3.5  and  3.6  that  the 
conditiona  (2.17)  -  (2.19)  of  Thaoraai  2.1  ara  nacaaaary. 
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To  pror*  that  theee  conditiona  ara  luffieknti  we  aaaume  that  they  hold 
and  analyse  tha  affect  of  dropping  a  single  activity.  Wa  show  that,  in  each 
caaa,  P(u*>  cannot  dacraaaa. 

By  tha  piacawiaa  linearity  of  P  and  tha  fact  that  nondifferentiabilities 
corraapond  to  activitiaa  of  type  i  or  ii,  thia  implies  that  P(u*)  cannot  dacraaaa 
in  any  diraction. 

Pirat  conaidar  tha  effact  of  dropping  Sk(u*)  for  k  t  J°.  Thua  d  = 

®Pkg(u*)i  where  Pk  ia  defined  in  Lemma  3.3.  Aa  in  tha  proof  of  Lemma  3.3, 
dT  a  Sfc(u*)  ~  <rXk  |  Pk  a  Sk(u*)  f*.  If  *  >  0,  Xk  £  0  iapHaa  that,  for 
aufficiently  small  «,  P(u*+«d)  =  P(u*)  +  «dTg(u*>.  Now  dTg(u*)  s 

a  I  Pkg(u*)  |s  >  0  iapliea  that  P(u*+«d)  >  P(u*).  If  «r  <  0,  Xk  £  0  iapliea,  aa 

in  Leaaa  3.4,  that  P(u*+«d)  =  P(u*)  +  «(Xk+l)dT  ▼  Sk(u*).  Thia  givea 
non-deacant  aince  Xk  >  -  1. 

Next  wa  conaidar  tha  effect  of  dropping  e*  for  k  *  I®.  Th'ua  d  =' 

•Qkg<u*),  where  Qk  ia  defined  in  Lemsm  3.5  or  d  a  »Rkg(u*),  where  Rk  ia 
defined  in  Leauan  3.6. 

Wa  flrat  conaidar  d  =  «Qkg(u*).  Than  dT(-ek)  =  I  Qkak  |a,  and  by 
hypothaeia  ^  >  0. 

If  v  >  0,  than  uf  decreaaee  and,  aa  in  tha  proof  of  Lemma  3.5,  P(u*+«d)  = 
P(u*)  +  «dTg(u*)  for  aufficiently  email  poeitive  «.  Now  P(u*+«d)  >  P(u*)  aince 
dTg(u*)  s  f  |  Qkg(u*)  |*  >  0. 

e  <  0  impliea  that  u$  increases.  Consequently,  if  there  axiata  j  « 
wa  violate  our  condition  that  only  one  activity  ia  dropped.  However,  if  J{(u*) 
ia  empty,  Qk  ia  identically  equal  to  Rk  and  d  =  «Qkg(u*)  s  eRkg(u*).  Thua,  aa 
in  tha  proof  of  Lemma  3.6,  omitting  all  tarma  involving  Jg(u*>,  wa  obtain  that 
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Ffi»*Md)  a  P(u*)  +  «dTg(u*+«d)  when  dTg(u*+«d)  a  vj» krk  |  I*  with  rk  a 

#Hi  -  |ltl*  Mow,  by  hypothesis  0  <  Mk  <  |lt(u*)|  which  baplies  rk  £  0  and 
lima  d»g(u*+ad)  >  0. 

II  faadwa  to  consider  d  a  *Rkg(u*).  If  »  <  0,  than  diractly  froa  tha 
proof  of  Lenna  3.6,  wa  have  P(u*+«d)  a  P(u*)  -  wkrk  |  Rkek  |*  for  any  aaaril 
positive  a.  If  *k  £  0,  than  dT(-ek)  a  svk  |  Rkak  |*  implies  that  uf  doaa  not 
daoraaaa  along  d  and  rk  ±  0  (from  (2.19))  impUea  that  P(u*+«d)  >  P(u^).  If 
<  0(  than  uk  daeraaaaa  along  d.  Tharafora  our  condition  that  only  ona 
activity  ia  droppad  inpMse  that  Jt(u*)  ia  anpty.  But  than  *k  a  a*  which  with 
(2.19)  implies  vk  £  0,  contradicting  vk  <  0. 

If  v  >  0  than*  aa  in  tha  proof  of  Law  3.6*  R*‘g(u*)  a  -  wk R*1 2  and 
dT(-ek)  a  rvk  |  Rkaii  |*.  Now*  if  vh  <  0,  u{  incraaaaa  along  d  and  P(u*+«d)  a 
P(u*)  ♦  adTg(u*+ad)  with  dTg(u*+ed)  a  -  wkakRkg(u*4«d)  a  wkrk  |Rkak  |*  £  0 
ainca  rk  £  0.  This  iapHee  P(u*+«d)  i  P(u*).  Pinally,  if  vk  >  0*  u{  daeraaaaa 
along  d  which  ones  again  violates  our  condition  that  only  ona  activity  is 
dropped  unlaao  Jt(u*)  ia  anpty.  Thao  vk  a  #»k,  Rk  a  Qk  and  P(u*4«d)  a 
P(u*)  v  adTg(u*)  fron  tha  proof  of  Leauea  31.  But  now  dTg(u*)  a  •  |  Rkg(u*) 

I*  >  o.  o 

4.  Tha  Algorithn 

Wa  now  praoant  a  Anita  algorithn  for  solving  problan  (2.1).  For  simplicity 
at  eapoottion*  wa  first  aasun a  that  nondaganaracy  holds.  Our  approach  to 
daganaracy  ia  sacplainad  in  tha  latter  part  at  this  section. 

(1)  Choose  any  u1  •  IP  and  aat  k  «-  1. 

(2)  Identify  J*(uk),  J*(uk>,  IJ(uk),  I}(uk),  j  •  J. 


(91  CbMKpttte  g<Uk>. 

(4)  Ooafutt  dk  *  -  P|(uk)  where  P  k  ddlaad  in  Section  3. 

(•)  If  dk  t  0,  then  go  to  (9). 

(()  Compute  Um  current  estimate  tor  the  Lagrange  dual  variables  Xj,  j  « 
l*(uk)  and  of,  i  •  I*(uk)  by  aohring 

g(ak)  ■  1  X,  e  Sj(uk)  -  I  Mi  at . 

J«J*(nk)  i«I#(uk) 

(7)  Stag  if  -  1  i  XJ  i  0  for  all  j  t  J*(uk) 

aad  0  i  m»  i  I  XI  +  |Jt(uk)|  for  all  i  .  I*(uk). 

(8)  Chooee  one  of  the  violated  inequalities  in  (7)  and  drop  the  correeponding 

activity.  Lei  <  •  J*(uk)  «  I*(uk)  be  Ha  index.  Define 

-  P*g(uk)  if  XJ|  >  0  or  if  Xk  <  -  1,  whore  P1  ia  defined 

in  Laona  3.3. 

dk  «  -  Q«g<ok)  if  M|  <  0.  where  Q*  ia  defined  in  hmmm  3.5. 

-  l*g<uk)  if  mJ  >  -  I  XJ  ♦  )  Jj  J ,  where  B*  ia  defined 

j«J| 

in  Lamaa  3.6. 

where  our  preference  ia  to  chooea  dk  ia  the  order  Xk  >  0,  mJ  <  0,  Xj  <  -  1, 

m5  >  -  I  Xt  ♦  | Jt  I,  whenever  there  ia  a  choice. 
j.J| 

(9)  Deteraine  the  atep  aiae  «k  by  aolving  Min  F(uk+«dk)  subject  to  keeping 

«>0 

all  activitiee  active  (except,  of  couree,  tor  the  activity  dropped  in  (8) 
when  atep  (8)  ia  performed  in  iteration  k).  Thia  line  aearch  can  be  done 
by  atarting  from  uk  and  moving  from  one  breakpoint  of  P  to  the  next,  in 
the  direction  dk,  until  either  the  value  of  P  atarta  increasing  or  an 
active  Sj  becomes  nonactive. 
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(10)  »fcti  and  iUntt. 

H**1  ■  gk  4  akjk 

k  *k  ♦  1 

So  to  (2). 

IMb  IWriwItw  of  the  UgarilM 

A  paint  u  ouch  that  Pg(u)  «  0  is  called  a  stationary  point. 

First,  not#  that  at  Moot  n  iterations  can  occur  bsfors  a  stationary  point  is 
reached  siaost  whenever  wt  are  not  at  a  stationary  point,  tho  lino  search 
picks  up  at  least  one  new  activity  while  sdatainini  those  satisfied  at  the 
beginning  of  the  iteration.  We  next  renark  that  there  are  only  a  finite 
nuaber  of  stationary  points  because  of  the  piecewise  linear  nature  of  the 
objective  function  —  Le.  the  e/s  and  *  Sj’s  cons  froa  a  finite  collection,  as 
doss  g(u).  Finally,  it  is  not  possible  to  return  to  any  given  stationary  point, 
since  the  objective  function  sequence  (F(uk )}  is  monotonic  decreasing.  Thus 
tersdnation  occurs  in  a  finite  number  at  iterations. 

Furthermore,  the  work  required  within  each  iteration  is  finite.  In 
particular,  in  the  line  anarch  (9),  a  breakpoint  of  type  ii  occurs  when  uf  + 
s  cjj  for  sons  i  «  I  and  j  i  J.  Given  the  current  point  and  the  sign  of 
dt  it  is  easy  to  find  the  next  such  breakpoint  of  type  ii.  A  change  in  the 
sign  of  Sj(u)  between  two  consecutive  breakpoints  of  type  ii  yields  a 
breakpoint  of  type  i  since  Sj  is  linear  in  that  range.  So  breakpoints  of  type 
i  are  easy  to  find  as  well.  Since  there  are  only  finitely  many  breakpoints 
along  the  line  uk  +  ad*,  the  line  search  is  finite. 


(a)  Although  u1  can  bo  ehooon  arbitrarily  in  stop  (1),  there  are  advantages 
in  chopping  either 

(i)  u]  s  second  largest  ctj  over  j  «  J, 
or  (U)  the  beet  heuristic  dual  solution  determined  by  Brlenkotter  [10]. 

(b)  The  line  search  described  in  (9)  can  be  modified  to  take  into  account  the 
remark  made  in  Section  1  that  there  always  exists  an  optimal  solution  such 
that  Sj(u)  <  0  for  all  j  »  J.  Specifically,  assume  that  SjfuM  <  0  has  been 
maintained  through  iterations  t  :  1,  ...»  k.  Perform  the  line  search  by  moving 
from  one  breakpoint  of  P  to  the  next  until  the  first  of  the  following  events 
occurs: 

(i)  F(uk+edk)  starts  increasing, 

(ii)  Sj(uk4«dk)  becomes  inactive  for  soma  j  •  J#(uk)  [J6(uk)\{<}  if  uk 
is  stationary], 

(iii)  Sj(nk+«dk)  becomes  positive  for  some  j  •  J(uk). 

We  denote  by  LSI  the  line  search  described  in  (9)  and  by  LS2  the 
modified  line  search  described  here.  Thus  LS2  is  obtained  from  LSI  by 
adding  the  stopping  criterion  (iii). 

(c)  We  implsamnted  an  experismntal  code  for  the  purpose  of  this  article.  We 
use  QR  factorisations  that  are  updated  for  dropping  and  adding  activities  until 
there  are  a  possible  n  activities,  in  which  case  we  use  LU  factorisations  with 
updating.  This  is  adequate  since  our  primary  concern  in  this  paper  is  with 
the  number  of  iterations  required  to  reach  optimality.  An  ideal  version  of  the 
algorithm  would  use  genuine  large  sparse  techniques. 


The  difficulty  ariaM  in  the  degenerate  case  because  the  multipliers 
associated  with  (3.3)  are  then  no  longer  uniquely  defined.  A  unique  solution 
can  of  course  be  determined  if  one  chooses  a  basis  v  Sj  (u),  e,  from  j  *  J°  (u), 
i  *  I°(u),  and  seta  all  other  multipliers  to  zero.  We  note  that  this  is  exactly 
what  we  did  for  the  simple  example  given  in  Section  2.  The  problem  is  that, 
once  activities  are  dropped  in  Lexunss  3.3,  3.4,  3.5,  and  3.6,  one  has  to  verify 
the  consequence  to  the  dependent  activities.  Indeed,  this  is  exactly  analogous 
to  the  situation  in  linear  programming  and,  from  a  theoretical  point  of  view, 
can  be  handled  by  perturbation  techniques.  Prom  a  practical  point  of  view,  a 
perturbation  technique  is  undesirable  since  one  loses,  in  general,  the 
underlying  structure  of  the  location  problem.  One  may  use  an  approach 
analogous  to  that  of  Busovaca  [2],  namely  adding  the  conditions  of  Theorem  2.1 
as  explicit  constraints.  In  other  words,  one  recognizes  optimality  by  solving 

g(u)  *  l  X.  v  S,(u)  -  I  p(e, 
j«J°  isl* 

subject  to 

-  1  <  X j  <  0  for  j  •  J° 

0<Mi<  -  I  *i  +  |Jtl  for  i  «  I® 
j«J? 

as  a  constrained  least  squares  problem  in  X  and  jj.  Moreover,  if  no  solution 
exists,  an  optimal  point  has  not  been  found  and  a  descent  direction  can  be 
readily  constructed. 

For  the  purpose  of  the  present  article,  suffice  it  to  say  that 
(i)  degeneracy  is  a  relatively  cosmos  occurrence  for  uncapacitated  facility 
location  problow, 


(ii)  we  uara  able  to  solve  dsfananta  pr  obi awe  without  any  particular 
difficulties, 

(iii)  wa  outline  in  soma  detail  ona  algorithmic  approach  to  degeneracy  that 

ia  relatively  straightforward  and  affective  in  practice,  given  the 

special  structure  of  location  problans. 

Suppose  (3.3)  is  satisfied  but  Assumption  3.2  is  not.  Consequently,  one 

may  choose  a  basis  among  the  activities  such  that 

g(u)  a  I  x.  V  Sj(u)  -  I  M|S<  (4.1) 

j.J|  i.Ig 

where  the  subscript  B  indicates  that  a  basis  ia  being  chosen.  Further, 
without  loss  of  generality,  we  may  always  take  Ig  =  1°. 

Now  suppose  Xk  >  0  for  some  k  «  Jg  and  consider  d  -  -  Pkg(u)  aa  for 
Lemma  3.3.  Then 

dT  v  Sk(u)  *  -  Xk  |  P“  v  Sfc(u)  |a  <  0 
and  dTg(u)  *  XkdT  v  Sk(u)  <  0. 

To  find  out  whether  d  is  a  descent  direction,  we  compute  dTg(u+«d)  for 
small  positive  «.  Thus  it  remains  to  consider  dT  v  Sh(u)  for  h  «  J°\Jg.  For 
any  such  h,  we  can  write 

dT  V  Sh(u)  a  Ti,dT  V  Sk(u)  for  saam  yh  •  **•  (4.2) 

Let  D~  =  {h  «  J»\Jg  :  rh  <  0}  and 

D+  =  {h  *  J«\Jg  :  rh  >  0}.  Now 

dT  g(u+«d)  *  dTg(u)  +  T  dT  v  Sh(u+«d) 

h«D“ 

*  dTg(u)  +  I  dT  v  Sh(u) 
htD- 


direction  if 


X*  4  X  T*  >  0.  (4.3) 

h»r 

Mow  ouppooo  Xk  <  »  1  for  mm  k  ■  J|.  Usin|  the  —wo  direction  d  an 

•bore,  we  have  dT  *  Sk(u)  >  0.  So,  here,  dTg(u+ed)  =  dTg(u)  ♦  dT  *  Sk(u)  + 

X  dT  *  8*(n).  Therefore,  we  obtain  that  d  ia  a  daacent  direction  if 
he®4 


**  4  1  4  X  To  <  0.  (4.4) 

hell4’ 

Suppoee  ^  <  0  for  aoaw  k  i  I|  and  conaidar  d  a  -  Q*f(u)  ee  for  Lewwa 
IS.  Than 


dT(-ek)  *  -  Mu  I  Q*e*  |a  >  0. 


(♦.5) 


f(e+«d)  *0  4-  £  «  Sj(wNhI). 

jej^efed) 

80,  in  order  to  know  the  aiffn  of  dr*<u*ed)  for  eawll  pooitire  «  we  need  to 

oonaider  dT  *  Sh(u)  for  h  e  We  can  write 

dT  *  «*<»)  *  To  dT(-e*)  for  h  e  J%J|  (4.6) 

Let  D-  «  (h  e  J*\J|  :  7*  <  0)  and  D4  a  (h  *  J«\J|  ;  T„  >  0).  Then 

dTf(e*ed)  «  dTf(«)  ♦  I  dT  *  8»(e+«d) 

he®4 

*  0»*4  X  7*)  dT(-eh). 

he®4 

Therefore  d  ia  a  d— cant  direction  if 


We  4  XT*  <  0.  (4.7) 

he®4 

finally,  it  raen ina  to  conaidar 

W*  >  -  I  Xj  ♦  |Jtl  (4.8) 

J«Jta 

Jfa  *  Jt  «  J|.  let  d  *  -  Kkg(n)  ee  for  Lanna  3.6.  Than 

dT(-e*)  «  -(m*+  £  X.)  |  Hfcek  |*  <  0. 

W*  a 
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DvfiM  Th  for  h  *  J®\J|  by 


dT(*  Sh(u)+ek)  »  r»,  dT(-ek)  if  h  «  J{\J| 

d*  ;  Sh(u)  *  yh  d*(-ek)  it  h  « 

Let  D“  a  {h  »  J*\J|  :  7h  <  0}  and  D*  s  [h  «  J°\JI  :  7h  >  0)  Now 

dTf(u+*d)  *  dTg(u)  -  |Jt(i»)|dT(-«k)  ♦  E  dT  *  Sh(t»+ad) 

h«D~ 

*  (Ma  ♦  I  X.  -  |Jtl+  I  7h)  d*(-ek). 
j«J{a  h«D" 

Tharafora  d  is  a  daacant  direction  if 

Mk  >  -  I  x.  +  lit!  -  I  7h.  (4.9) 

j«JfB  halT 

S.  Nuawial  Baaulla 

Tha  first  sat  "of  rsaults  given  sra  for  s  class  of  tan  33  *  33  problems 
whara  tha  c<  j  values  sra  taken  from  data  for  a  traveling  salesman  problem 
[IS].  This  is  a  well-known  teat  sat  considered  representative.  It  was  solved 
for  example  by  Schrage  [20]  and  Brlenkotter  [10]. 

We  give  results  far  two  different  paints 

(a)  Uf  —  0  i  —  If  •••!  33 

(b)  uj  =  c,k  i  *  1,  ...»  33,  where  c(k  is  the  second  largest  entry  for 
given  i,  and  the  two  different  line  search  algorithms  LSI  and  LS2.  No 
results  are  given  in  the  latter  case  for  fixed  charges  184  and  295  since  not  all 
the  Sj'a  are  initially  positive. 
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Fixed  Charge 

*  of  iterations 

Uo  =  0  Uo  = 

LSI  LS2  LSI 

-i  k 

LS2 

F(u*) 

184 

3 

3 

10 

-  6024 

296 

10 

14 

9 

-8673 

500 

14 

21 

11 

20 

-11267 

1000 

10 

17 

9 

12 

-14832 

1500 

18 

23 

15 

19 

-17832 

2000 

39 

40 

26 

.31 

-20346 

2500 

41 

32 

28 

27 

-22127 

3000 

30 

23 

14 

22 

-23474 

4000 

11 

8 

8 

7 

-25474 

5000 

5 

7 

4 

5 

-27474 

We  not*  that  only  the  problem  with  fixed  charge  2000  has  a  duality  gap 
[the  solution  is  -  20363].  Next  we  consider  this  problem  in  more  detail.  Using 
the  complementary  slackness  conditions  (2.20)  -  (2.24),  we  get 
xf  =  x?  =  xf  =  xf3  =  xf*  =  1/2, 
xf©  =  xf*  =  1  and  x^  =  0  for  all  the  other  j*s. 

The  fractional  yf  j  are  as  follows.  * 

y»,3  =  y a,3  =  y s,3  =  y*,s  -  y»,a  -  y *,s  *  1/2 

ya,7  =  y  4,7  =  y  3,7  -  y*,?  =  y  7 ,7  =  y  »,7  =  y  *,7  =  y  10,7  =  1/2 

y>,(  3  y»,*  =  y»,»  =  y»,»  3  yio,a  =  yi*,*  3  yu,#  =  1/2 

y»,»s  3  yti.ts  3  yi2,>3  3  y»s,is  3  yi*,is  3  yis,is  -  yi*,is  3  yi7,*3  =_i/2 

y>3,i4  3  y»4,i«  3  y»s,i4  3  yu,t«  3  y»7,i«  3  1/2. 

The  remaining  i  *  I  are  assigned  to  either  facility  20  or  24,  whichever  is 
closer. 

Note  that  there  are  several  cuts  of  the  form  (1.15)  that  cut  off  the  above 
fractional  solution  (x*,y*).  In  fact  there  are  18  such  cuts.  Sixteen  of  these 
cuts  involve  the  variables  xs,  x7  and  x*.  The  other  two  involve  the  variables 
x3,  xa  and  x13.  We  show  one  cut  of  each  type. 
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Ch*t  1  7i,t  ♦  7a, s  ♦  7a, •  ♦  7»»,s  ♦  7»,ia  ♦  7u,is  ***  i  1 

Cut  2  7a,a  ♦  7*, a  ♦  7«,7  ♦  7*,t  ♦  7a, a  ♦  7  »,a  "*»“*»  "  *•  i  1 

Addins  Umn  two  cuts  to  the  formulation  jrialda  a  modified  condensed  dual 
with  two  now  dual  variables,  aay  vx  aaaociatad  with  Cut  1  and  v,  associated 
with  Cut  2  (See  (1.16)  and  (1.17)].  Starting  froai  tha  prtrioua  optimum  dual 
solution  u*,  wa  only  naadad  9  additional  iterations  to  aohra  tha  aodifiad 
condanaad  duaL  Wa  found  an  nptlsml  dual  aolution  (u**,t**)  with  vf*  s  44 
and  rf*  s  20  but  thara  ara  altarnata  optima,  aa  ia  typical  with  problaai  (2.1). 
Using  tha  coarpleamntary  alacknaaa  conditiona  (5.1)  -  (5.5),  wa  now  hava  an 
integer  primal  optimum  aolution: 

x7  s  a,*  s  x„  s  x,«  si,  Xj  s  0  otherwise. 

This  aolution  is  uniqus.  Inatancaa  whara  tha  dual  formulation  has  altarnata 
optima  and  tha  primal  has  a  uniqus  aolution  aaam  to  ba  typical  for  tha 
uncapacitatad  facility  location  problem.  At  any  rata,  wa  have  observed  it 
frequently  whether  it  ba  with  or  without  tha  addition  at  cuta. 

Wa  give  another  illustration  of  tha  cutting  plana  approach.  By  drawing 
tha  j’a  randomly  from  a  uniform  distribution,  duality  gaps  ara  more  likely  to 
occur  than  whan  tha  c,  j’s  satisfy  tha  triangle  inequality  (such  aa  .in  tha 
above  33-city  problem),  [1].  Consider  tha  following  problem,  where  c, j  was 
drawn  at  random  between  0  and  100  and  whara  f j  s  100  few  every  j. 


(75 

56 

74 

88 

19 

3 

46 

21 

29 

39] 

52 

10 

79 

62 

12 

9 

52 

88 

76 

31 

86 

59 

58 

87 

63 

73 

3 

79 

80 

27 

17 

68 

35 

70 

75 

3 

87 

72 

13 

35 

64 

32 

40 

73 

11 

93 

30 

80 

64 

71 

70 

33 

44 

71 

34 

21. 

20 

56 

59 

19 

56 

56 

9 

21 

40 

7 

93 

50 

49 

27 

42 

14 

69 

16 

77 

85 

36 

52 

72 

98 

41 

5 

99 

21 

27 

51 

23 

89 

23 

68 

164 

32 

59 

29 

96 

31 

81 

83 

4 

63J 
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Idhtef  problem  (2*1)  using  ths  algorithm  at  Section  4  with  Hns  March 
algorithm  LSI,  ws  obtain  ths  following  optimum  vector  u,  with  value  P(u) 
s  Ctl  ♦  2/S. 

Vi  s  22  4  2/3y  U|  s  62,  u,  s  63,  u,  s  70,  u,  s  71,  u,  s  52+1/3,  u,  —  37,  u^  — 
52,  u,  s  74+1/3,  and  u,(  s  67+1/3. 

Using  (6.1)  •  (6^),  ws  gst  ths  primal  optimum  solution 
s»  s  z«  a  s  1/3,  >•  s  2/3  and  zj  :  0  othsrwiss. 
rt9»  s  2/3  for  i  t  1, 

7i,l  *  7i,4  *  ft,*  *  7i,s  8  8  7*,t  a  7i,»  a  7i,«  a  7t,»  a  7i,i  8  7t,i  a 

y»e,»  *  1/3,  7»J  *  0  othsrwiss. 

It  was  shown  in  [3],  [8],  [13]  that  ths  following  inequality  dsfinss  a  facat  of 
ths  unoapsoitatsd  facility  location  polytops.  Furthsrmors .  it  cuts  off  the 
currant  fractional  solution. 

(ht  l  y»,»  ♦  ♦  y»,»  ♦  y*,*  ♦  7t,«  +  y*,«  ♦  7*,«  +  y4,,  ♦  y*,«  +  y*,s  + 

y*,»  +  y*,e  -j»-«4M,M,i2. 

Adding  H  to  ths  formulation  and  aohring  ths  nsw  condsnasd  dual  yislda  an 
optimum  solution  value  at  675.  Going  back  to  ths  primal  through  (5.1)  -  (5.5), 

ws  bars 

i,  s  x,  s  i,  :  i,  s  1/2,  zj  s  0  otherwise, 

7»,»  *  y»,4  a  y»,»  *  7a,i  *  y*,4  a  y*,»  a  7«,»  a  y4,«  a  yi,4  8  y»,»  8  7«,4  8 
y«,e  *  y»,T  *  y»,«  8  y*,*  8  y«,«  8  y*,s  =  y*,«  =  yl0,r  =  y»*,»  8  1/2, 
yij  8  0  othsrwiss. 

Ws  addsd  nezt 

2  7i,*  +  y»,4  +  y*,*  +  y*,*+  y*,4  ♦  y»,«  *  *>  ■  *4  -*#  i  l 

reducing  ths  optimum  solution  value  to  673.5,  and  than 
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«■*  *  7*fs  ♦  7*,«  ♦  y*,4  ♦  7s, •  ♦  7*,a  ♦  7»,s  -  *»  -  x«  -  X.  <  1. 

The  optimal  solution  of  tha  now  condensed  dual  was 

ut  »  SI,  U|  :  52,  u3  r  62,  u«  s  48,  u9  =  66,  u*  :  S3,  u7  =  50,  u,  =  49,  u,  = 
40,  ut(  s  64,  vs  s  24,  ▼,  s  8,  v,  s  9  whan  v,  is  aaaociatad  with  Cut  i, 
i  *  1,  2,  3.  Tha  corresponding  valua  ia  F(u,v)  s  570.  Mow  using  (5.1)-(5.5) 

z,  =  1,  y»«  s  1  for  all  i, 

Xj  s  0  and  y  j  j  =  0  for  j  X  8. 

6.  BslsHnnalrip  with  Brlenkotter’s  Heuristic 

A  wall-known  hauriatic  approach  to  tha  condanaad  dual  problem  ia  that  of 
Brlankottar  [10].  This  method  ia  simple  and  often  vary  effective.  We  analyze 
it  in  the  context  at  our  proponed  method. 

Firstly,  at  all  iterations  of  Brlenkotter’s  heuristic  all  Sj’s  are  nonpositive. 
Consequently,  g(uk)  =  e  for  all  k. 

We  remark  that  tha  descant  direction  given  by  our  algorithm  amounts  to 
steepaet  descent  in  the  particular  subspace  defined  by  Lemmas  3.1,  3.3,  3.4, 
3£  and  3.6. 

By  contrast  Rrlenkotter’s  dual  descent  procedure  corresponds  to  a 
coordinate- wise  search  until  a  new  activity  of  type  ii  is  found  or  until  blocked 
by  an  activity  at  type  i,  repeating  until  no  descant  is  so  obtained.  Consider, 
say,  a  search  along  d  s  -ek.  It  is  immediate  that  dTg(u)  <  0  and  Brlenkotter’s 
line  search  is  effectively  stopped  whenever  an  S  j  <.  0  becomes  positive.  Since 
uh  is  decreasing  but  all  other  u<’s  remain  fixed  it  ia  clear  that  all  activities 
rsmain  active  except  poesibly  an  activity  of  type  ii,  given  by  ckj  =  uk,  which 
one  could  consider  to  have  been  dropped.  In  the  former  case,  we  clearly 
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bm  a  direction  la  iha  apaea  dafinad  by  Lana  3.1,  although  no  longer  in  tha 
■1b apart  clamant  direction  in  general.  In  tha  lattar  caaa  wa  have  a  direction 
at  tha  typa  dafinad  by  Laauaaa  3.5  or  3.6,  but  again,  in  ganaral,  no  longar  in 
tha  steepest  daaeant  diraction. 

Thrirtantlj.  what  tha  dual  daaeant  proeadura  lacks  in  sophistication  it 
makes  up  tor  amply  (at  laast  for  medium-sise  problaa is)  in  tha  simplicity  of 
tha  computations.  Tha  dual  adjustment  procedure  adds  one  levsl  at 
complication  to  tha  choice  of  search  direction  when  optimality  cannot  be 
reached  via  coordinate-wiae  search. 

More  particularly,  suppose  ckj  >  uk  for  more  than  one  j  *  J*(u),  jt,  ja,  ... 
it  “T* 

Now  suppose  wa  incraass  uk.  Consequently  Sj^...  Sjt  that  ware  active 
become  negative.  He  can  now  attempt  to  decrease  other  uj’s  that  appear  in 
Sji ,  ...,  Sjt-  If  more  than  one  such  Uj  can  be  decreased  unit  for  unit  as 
uk  increases,  any  u«  i  s  i„  is,  ...,  is,  wa  gain  and  P(u)  decreases. 

Thus  in  effect  wa  are  searching  in  a  direction 

s 

d  *  ek  -  I  •(,. 

P*1 

In  other  words,  s  +  1  activities  of  type  ii  are  dropped,  one  by  increasing  uk 
and  tha  r— rining  s  by  dacreaaing  u<f.  In  addition,  several  activities  of  . 
typa  i  may  also  be  dropped  in  tha  search  direction  d. 

Tha  essential  ingredients  of  tha  method  that  wa  have  presented  are: 

(i)  F  is  a  sun  of  noodiffersatiable  functions. 

(ii)  Tha  coabinatorial  structure  of  the  problem  can  be  exploited. 

Sea  Cal  Mai  and  Conn  [4],  and  Conn  [5]  for  additional  related  background. 


at 


id—  io  other  atruetured  Mnaa r 
ooadanaa d  fora.  This  ia  not  an 


la  tet(  Um 


at  tha  atroni  Hnaar  prograaaiiii 


fbdlity  location  problem  itaalf  haa  euch  a 


*1  0, 


I  *j  l  1 


I  *i(«)  -  Z  fj*j 
i»I  j#J 


where  S|(x)  ia  the  piecewiee  linear  concern  function  dafiaad  by 

*i(x)  *  aia  (cu+  I  (c1J-C|fc)’f  x«). 
kaJ  jaj 

Equivalently  x,(x)  *  cfk  ♦  I  (cij-cifc)*  Xj 
where  k  ia  dafiaad  by 

I  Xj  <  1  i  I  Xj. 

j:c4j>clk  j:c,jic1k 

In  general*  probleaw  with  find  chargee  auch  aa  network  deaign  or 
lot  eiaing  problaaM  ham  linear  programming  relaxation  a  that  any  adaut  a 
condanaad  fora. 


The  oapacitatad  facility  location  problem  ia  obtained  by  adding  the 
capacity  eonetrainta 

Z  j  £  ajXj  for  j  •  J  (7.1) 

i»I 

to  the  formulation  (l.l)-(l.S).  Here  d  <  repreoenta  the  demand  of  client  i  and 
a<  the  capacity  at  a  facility  at  location  j.  Tha  dual  of  the  linear  prograanaing 
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f 


m»  X  ♦  X  t . 

*1  ♦  *1 J  ♦  1  C«  J 


for  oil  i  •  I,  j  ■  J 


-  X  W|j  ♦  tj  -  iiVi  1  -f j  for  oil  j  «  J 
ial 


"U*  ti*  Tji  0 
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Mia  F(«,v)  *  X  a*  ♦  X  St(«*v) 
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ij(«.v)  «  X  (cij-u*-d,Vj)+  +  ojoj  -  fj 
ill 

As  for  Um  unoopocttotod  problm,  F(u,v)  is 
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•  Uneapecltated  facility  location  problem,,  simple  plant  location  problem, 

?  strong  linear  progressing  relaxation,  condensed  dual.  Projection  Method, 

}  Ron* Smooth  Optimisation. 


ASSTRACT  fCamttmm  m  ww  «M*  M  MIMIMM  M  MM NO  f  Mm*  mammi  ( 

Several  algorithms  already  exist  for  solving  the  uncapacitated  facility  j 
location  problem.  The  moat  efficient  are  based' upon  the  solution  of  the  strong  j 
llneer  programalng  relaxation.  The  dual  of  this  relaxation  has  a  condensed  form! 
which  consists  of  minimising  a  certain  piecewise  linear  convex  function.  This  : 
paper  presents  a  new  mathod  for  solving  the  uncapaeltated  facility  location  \ 
problem  baaed  upon  the  exact  solution  of  the  condansad  dual  via  orthogonal  j 
projections.  The  amount  of  work  per  Iteration  Is  of  the  same  order  as  that  of  aj 
simplex  Iteration  for  a  linear  program-  le -m  variables  and  constraints,  where  m  j 


1473  COITION  OF  I  MOV  ••  I*  < 
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it  the  easfcer  of  iliwtt.  Vev  eeaperlsoa,  the  underlying  11— v  prog— log  duel  has 
I  iwlrtlii  end  an  4>  a  constraints,  where  a  le  the  auaber  of  poteatlel 
taeetloae  for  the  facilities.  The  aethod  is  flexible  es  It  eea  handle  side  eoostrelnts. 
Xa  particular,  ehen  there  Is  e  duality  gap,  the  lloeer  progmaalng  focaulatloa  eea  be 
streagtheaed  by  adding  eats.  M— rlesl  results  for  soaa  elsssleel  test  probl—  ere 
lasleded. 


